Method for controlling the display of a portable computing device

ABSTRACT

The present document describes a method for controlling an output presented on a visual display of a portable computing device having an orientation, the portable computing device comprising a memory on which is stored visual content comprising at least one of graphics data, photo data and video data, and text content substantially comprising text data, the text content further comprising a visual content indicator indicative of the existence of the visual content, the method comprising: detecting the orientation of the portable computing device as corresponding to one of a first display mode and a second display mode; in the orientation corresponding to the first display mode, presenting the text content on the visual display in the first display mode; in the presence of the visual content indicator, detecting a change of the orientation corresponding to the first display mode to the orientation corresponding to the second display mode; and in the orientation corresponding to the second display mode, presenting the visual content in the second display mode on the visual display.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims priority of U.S. Provisional Application No.61/757,406, filed on Jan. 28, 2014, the specification of which is herebyincorporated herein by reference in its entirety.

BACKGROUND

(a) Field

The subject matter disclosed generally relates to methods forcontrolling display of portable computing devices and to portablecomputing devices controlling an output presented on a visual display.

(b) Related Prior Art

A tablet computer (i.e., an iPad for example) is a one-piece mobilecomputer, primarily operated by touchscreen (i.e., the user's fingeressentially functions as the mouse and cursor, removing the need for thephysical (i.e., mouse and keyboard) hardware components necessary for adesktop or laptop computer, and an onscreen, hideable virtual keyboardis integrated into the display).

As of March 2012, 31% of U.S. Internet users were reported to have atablet, which was used mainly for viewing published content such asvideo and news. Portable computing device using touch screen functionsare very popular these days.

Typical functions of portable computing devices are: high definitiondisplays with anti-glare technology; wireless mobile browser functions(using 2G, 3G, 4G or WiFi); e-mail and social media devices (typicallywith integration apps to bring all feeds into the same view); potentialcell phone functions (messaging, video calling, speakerphone or headsetcell phone uses); video-teleconferencing (Skype, FaceTime, etc.), GPSsatellite navigation, stills and video camera functions, photo and videoviewing and editing, eBook reading and the ability to subscribe to andread daily/weekly/monthly/annual magazines, newspapers, or otherperiodicals, read interactive and traditional graphic novels and comicbooks; downloadable apps (games, education, utilities); portable mediaplayer function including the ability to watch video (both streaming andlocally stored); academic readings and the like.

There is therefore a need for improved methods for controlling displayof portable computing devices and for portable computing devicescontrolling an output presented on a visual display.

SUMMARY

According to an embodiment, there is provided a method for controllingan output presented on a visual display of a portable computing devicehaving an orientation, the portable computing device comprising a memoryon which is stored visual content comprising at least one of graphicsdata, photo data and video data, and text content substantiallycomprising text data, the text content further comprising a visualcontent indicator indicative of the existence of the visual content, themethod comprising: detecting the orientation of the portable computingdevice as corresponding to one of a first display mode and a seconddisplay mode; in the orientation corresponding to the first displaymode, presenting the text content on the visual display in the firstdisplay mode; in the presence of the visual content indicator, detectinga change of the orientation corresponding to the first display mode tothe orientation corresponding to the second display mode; and in theorientation corresponding to the second display mode, presenting thevisual content in the second display mode on the visual display.

According to another embodiment, the detecting the orientation ascorresponding to one of a first display mode and a second display modecomprises detecting the orientation as corresponding to one of aportrait mode and a landscape mode, respectively.

According to another embodiment, there is further provided, in theorientation corresponding to the second display mode, detecting thechange of the orientation corresponding to the first display mode to theorientation corresponding to the second display mode, for presenting thetext content on the visual display in the first display mode.

According to another embodiment, there is further provided, in theorientation corresponding to the first display mode, selecting thevisual content indicator for triggering a display of the visual contenton the visual display, the selecting comprising at least one of clickingand tapping on the visual content indicator presented on the visualdisplay.

According to another embodiment, the presenting a text contentcomprising a visual content indicator comprises presenting a textcontent comprising a plurality of visual content indicators indicativeof the existence of a corresponding plurality of visual contents, andwherein detecting the change of the orientation in the presence of avisual indicator comprises detecting the change of the orientation inthe presence of the plurality of visual content indicators, and whereinpresenting the visual content in the second display mode comprisespresenting one of the plurality of the visual contents.

According to another embodiment, there is further provided, in theorientation corresponding to the second display mode, swiping the visualdisplay for introducing a panel comprising the text content fordisplaying both the text content and the visual content on the visualdisplay.

According to another embodiment, presenting a text content on the visualdisplay comprises presenting a text content comprising a table ofcontents on the visual display, the table of contents comprising avisual indicator indicative of the existence of visual content.

According to another embodiment, there is further provided, afterpresenting the visual content, detecting a swipe on the visual displayfor navigating between a plurality of visual contents.

According to another embodiment, there is further provided, in theorientation corresponding to the second display mode in which a givenvisual content is displayed, detecting the change of the orientationcorresponding to the first display mode to the orientation correspondingto the second display mode, for presenting on the visual display, in thefirst display mode, the text content which corresponds to the givenvisual content.

According to another embodiment, there is further provided generating acount of each change of the orientation corresponding to the firstdisplay mode to the orientation corresponding to the second displaymode, and at least one of: storing the count on the memory and sendingthe count to a remote server via a communication network.

According to another embodiment, there is further provided determining apayment based on the count.

In another aspect of the invention, there is provided a portablecomputing device for controlling an output presented on a visualdisplay, the portable computing device comprising: a visual displaypresenting an output; a detector for detecting an orientation of theportable computing device, the orientation corresponding to one of afirst display mode and a second display mode; a processing device incommunication with the visual display and the detector; a memory forstoring: visual content comprising at least one of graphics data, photodata and video data, and text content substantially comprising textdata, the text content further comprising a visual content indicatorindicative of the existence of the visual content; and instructionswhich cause the processing device: to detect the orientation of theportable computing device as corresponding to one of the first displaymode and the second display mode; in the orientation corresponding tothe first display mode, to present the text content on the visualdisplay in the first display mode; in the presence of the visual contentindicator, to detect a change of the orientation corresponding to thefirst display mode to the orientation corresponding to the seconddisplay mode; and in the orientation corresponding to the second displaymode, to present the visual content in the first display mode on thevisual display.

According to another embodiment, the detector for detecting anorientation corresponding to one of a first display mode and a seconddisplay mode comprises a detector for detecting an orientationcorresponding to one of a portrait mode and a landscape mode.

According to another embodiment, the memory is further for storinginstructions which cause the processing device to, in the orientationcorresponding to the first display mode and upon a swipe on the visualdisplay, display a panel comprising the text content for displaying boththe text content and the visual content on the visual display.

In another aspect of the invention, there is provided an interactiveapplication for controlling an output presented on a visual display of aportable computing device comprising a memory, the interactiveapplication comprising: a detection module for detecting an orientationof the portable computing device, the orientation corresponding to oneof a first display mode and a second display mode; a text contentsubstantially comprising text data for display when the orientationcorresponds to the first display mode; a visual content indicatorpresented within the text content, the visual content indicator beingindicative of the existence of visual content comprising at least one ofgraphics data, photo data and video data; the visual content presentedwhen the detection module detects that the orientation corresponding tothe first display mode changes to the orientation corresponding to thesecond display mode in presence of the visual content indicator, whereinthe text content, the visual content indicator and the visual contentare stored on the memory.

According to another embodiment, the detection module for detecting anorientation corresponding to one of a first display mode and a seconddisplay mode comprises a detection module for detecting an orientationbeing one of a portrait mode and a landscape mode, respectively.

According to another embodiment, the text content is an electronic book.

According to another embodiment, the text content further comprises atable of contents, the table of contents comprising the visual indicatorindicative of the existence of the visual content.

According to another embodiment, there is further provided, when theorientation is detected to correspond to the first display mode, a panelcomprising the text content for displaying both the text content and thevisual content on the visual display.

According to another embodiment, the visual indicator comprises aplurality of visual indicators indicative of the existence of acorresponding plurality of visual contents, and wherein the detectionmodule for displaying the visual content comprises a detection modulefor displaying one of the visual contents which corresponds to one ofthe plurality of visual indicators.

Features and advantages of the subject matter hereof will become moreapparent in light of the following detailed description of selectedembodiments, as illustrated in the accompanying figures. As will berealized, the subject matter disclosed and claimed is capable ofmodifications in various respects, all without departing from the scopeof the claims. Accordingly, the drawings and the description are to beregarded as illustrative in nature, and not as restrictive and the fullscope of the subject matter is set forth in the claims.

BRIEF DESCRIPTION OF THE DRAWINGS

Further features and advantages of the present disclosure will becomeapparent from the following detailed description, taken in combinationwith the appended drawings, in which:

FIG. 1 is a block diagram of a portable computing device for controllingan output presented on a visual display in accordance with anembodiment;

FIG. 2 is a flow chart of a method for controlling the output presentedon a visual display of a portable computing device in accordance withanother embodiment;

FIG. 3 is a schematic illustration of the system for controlling theoutput presented on a visual display of a portable computing device; and

FIGS. 4 to 37 are illustrations showing a visual display of a portablecomputing device in accordance with various embodiments.

It will be noted that throughout the appended drawings, like featuresare identified by like reference numerals.

DETAILED DESCRIPTION

In embodiments presented herein there are disclosed methods forcontrolling display of portable computing devices and to portablecomputing devices controlling an output presented on a visual display

Referring now to the drawings, and more particularly to FIG. 1, there isshown a block diagram of a portable computing device 10 for controllingan output 14 presented on a visual display 12. The portable computingdevice 10 includes a visual display 12 presenting an output 14 and adetector 26 for detecting an orientation of the portable computingdevice 10. The detector 26 may comprise an accelerometer. Theorientation may be one of a portrait mode 16 and a landscape mode 18 orone of a substantially horizontal mode and a substantially verticalmode. The portable computing device 10 also includes a processing device28 which is in communication with the visual display 12 and the detector26. The portable computing device 10 further includes a memory 30 forstoring instructions which cause the processing device 28: to detect theorientation of the portable computing device 10 as being one of theportrait mode 16 and the landscape mode 18; in the portrait mode 16, topresent a text content 20 on the visual display 12, the text content 20substantially comprising text data, the text content 20 furthercomprising a visual content 24 indicator 22 indicative of the existenceof visual content 24 comprising at least one of graphics data, photodata and video data; in the presence of the visual indicator, to rotatethe portable computing device 10 to the landscape mode 18; and in thelandscape mode 18, to present the visual content 24 on the visualdisplay 12.

Typical examples of a portable computing device 10 include electronicreaders, smartphones, tablets, phablets and, more widely, may also referto cell phones, portable music players and other handheld electronicdevices. However, given the pace of technological advancements in thisfield, the terms “portable computing device” may embrace newtechnologies that do not exist now but in which the method describedherein can be implemented as in existing portable computing devices.These new portable computing devices should be considered as possiblevariants of the portable computing device 10 described herein.

The memory 30 for storing instructions can be an optical memory, amagnetic memory, or other types of memories known in computerengineering to store instructions and data. The instructions stored onthe memory usually include routines, programs, objects, components, datastructures, etc., that perform particular tasks or implement particularabstract data types and cause other parts of the computing environmentto interact (communication, data exchange) together.

The processing device 28 is an electronic device configured forperforming calculations, executing tasks with respect to theinstructions that are received and more generally, perform logicaloperations.

The visual display 12 for presenting an output 14 may comprise what iscommonly called a screen. The screen can be of various types dependingon the underlying technology. Some types of screen include emittinglight (smartphones, tablets) whereas others do not (such as readers).Many portable devices comprise a touch-sensitive screen, although themethod described herein can be implemented in a device in which thisfeature is absent.

The processing device 28, the memory 30, the detector 26 and the visualdisplay 12 can be operatively connected through a system bus or anyother type of communication channel known in computer engineering totransmit electric, magnetic or optical information between thecomponents of a computing device. In an embodiment, one (or more)component is external to the portable computing device 10 andcommunicates with the other components using an electrical connection ora wireless communication. For example, the memory 30 may be a flashmemory which is external to the portable electronic device 10 butelectrically connected thereto.

The detector 26 is configured for detecting an orientation of theportable computing device 10. In most prior art devices, when theorientation is detected as being mostly vertical, the visual display 12a mode called portrait mode. Similarly, when the orientation is detectedas being mostly horizontal, the visual display 12 a mode calledlandscape mode. This aims to present information (text data, pictures,etc.) in an orientation that is more comfortable for the user in bothcases. In that sense, an orientation of the portable computing devicemay be considered as corresponding to a given display mode(portrait/substantially vertical and landscape/substantiallyhorizontal).

In an embodiment of the present invention, when the orientationcorresponds to a first display mode (which can be portrait, landscape,substantially vertical or substantially horizontal), instructions on thememory 30 are sent to present a text content 20 on the visual display12, the text content 20 substantially comprising text data, the textcontent 20 further comprising a visual content indicator 22 whichindicates that visual content 24 exists. When the portable electronicdevice is sufficiently rotated so that the detected orientationcorresponds to a second display mode (preferably the mode which iscomplementary to the first display mode, for example for passing fromthe portrait to the landscape mode), the change of orientation triggersthe display of the visual content 24 on the visual display 12, inaccordance with instructions stored on the memory 30 which are sent toperform this task. Whereas prior art devices display the same text datain two orientations as the display mode changes, an embodiment of theportable electronic device 10 displays text data (comprising a visualindicator 22) in an orientation and the visual content 24 thatcorresponds to the visual indicator 22 in the other orientation. Variousexemplary representations of the visual display 12 are illustrated inFIGS. 4-37 and described below.

According to an embodiment, the text content 20 (comprising text dataand visual content indicators 22) and the visual content 24 are bothalready downloaded and stored on the memory 30. Therefore, upon arotation of the portable electronic device 10 in the presence of avisual content indicator 22, when loading the visual content which is tobe displayed in the recently changed orientation, no network connectionis required. It means that no internet connection is needed to downloadthe visual content, since it is already pre-downloaded on the memory 30of the portable computing device 10. This feature allows the display ofthe visual content 24 when no connection with a communication network isestablished, like in the metro, in underground facilities, in remoteplaces or simply when the user of the portable computing device has nointernet package with a network provider. Of course, if a networkconnection is available, new content can be downloaded.

According to another embodiment and referring now to FIG. 2, there isshown a method 100 for controlling the output 14 presented on a visualdisplay 12 of a portable computing device 10. The method 100 includes astep 102 of detecting the orientation of the portable computing device10 as being one of a portrait mode 16 and a landscape mode 18 and thestep 104 of, in the portrait mode 16, presenting a text content 20 onthe visual display 12, the text content 20 substantially comprising textdata, the text content 20 further comprising a visual content indicator22 indicative of the existence of visual content 24 comprising at leastone of graphics data, photo data and video data. The method 100 alsoincludes the step 106 of, in the presence of the visual indicator 22,rotating the portable computing device 10 to the landscape mode 18; andthe step 108 of, in the landscape mode 18, presenting the visual content24 on the visual display 12. As mentioned above in reference with FIG.1, the portrait mode 16 and landscape mode 18 may be interchanged, ormay also be replaced by modes that are substantially vertical andsubstantially horizontal.

According to another embodiment and referring now to FIG. 3, there isshown a schematic illustration of the system 200 for controlling theoutput 14 presented on a visual display 12 of a portable computingdevice 10. The system 200 comprises a portable computing device 202 anda database 204 for storing the text content 20, the visual contentindicator 22 of the text content 20 and the visual content indicator 22.

According to another embodiment and referring now to FIG. 4, there isshown a visual display 12 of the portable computing device 10. FIG. 4illustrates the visual content indicator 22 on the text content 20. Forexample, the visual content indicator 22 may be a colored bar (i.e., ablue bar) on the left side of the text data of the text content 20, acolor highlighted text data or an icon, such as dots in the table ofcontents indicative of the existence of the visual content 24. It is tobe noted that any suitable visual content indicator 22 may be used toindicate the existence of the visual content 24. It is important to bemention that the orange arrowhead in the FIGS. 5-37 indicates that atransformation is taking place. This orange arrowhead does not appear onthe visual display 12 of the portable computing device 10.

According to another embodiment and referring now to FIG. 5, there isshown a visual display 12 of the portable computing device 10. In FIG.5, there is shown that when a blue bar is displayed on the text content20, it is possible for a user 32 to touch on the left-end side bar toaccess the visual content 24 without flipping the device (i.e., withoutflipping the portable computing device 10 from its portrait mode 16orientation to its landscape mode 18 orientation). As shown, as a step1, the user 32 reads the text data in the portrait mode 16 orientation.The user 32 then touches the left bar (i.e., the visual contentindicator 22) or rapidly clicks on the text data to display the visualcontent 24. In step 3, the user 32 can see on the visual display 12 thata visual content 24 slides down (or side) and the text data getsrepositioned. It is to be noted that when there is a visual indicator onthe visual display 12, user actions other than finger touch couldtrigger the visual content 24. For example, the voice of the user 32, orthe action of pressing on a specific button of the portable computingdevice 10 may bring the visual content 24 on the visual display 12.

According to another embodiment and referring now to FIG. 6, there isshown a visual display 12 of the portable computing device 10. FIG. 6shows that when the visual content indicator 22 (i.e., the blue bar) isdisplayed on the visual display 12, it is possible to rotate theportable computing device 10 to look at the visual content 24. In step1, the user 32 reads the text data in the portrait mode 16 orientation.Then, in step 2, the user 32 rotates the portable computing device 10 tolook at the visual content 24 in the landscape mode 18 orientation.

According to another embodiment and referring now to FIG. 7, there isshown a visual display 12 of the portable computing device 10. FIG. 7shows a review of the portable computing device 10 content through itsvisual contents 24 simply by finger touching an element on which theuser 32 wants more information. These actions may open a pop-up text forexample. Whenever the user 32 wants more detailed information, he canrotate the portable computing device 10 to get access to the originaltext content 20. In step 1, the user 32 can look at the visual content24 in the landscape mode 18 orientation. In step 2, the user 32 mayswipe to navigate between different visual contents 24. In step 3, theuser 32 decides to touch a text data (i.e., a text field) to get moredetails. In step 4, text content 20 with text data related to the visualcontent 24 will then slide down and in step 5, the user 32 rotates theportable computing device 10 to return to the original text content 20.

According to another embodiment and referring now to FIG. 8, there isshown a visual display 12 of the portable computing device 10. FIG. 8illustrates an end of chapter review. Indeed, at the end of a chapter(i.e., of a book, a magazine, and the like), a review of its visualhighlights is available for the user 32, by simply rotating the portablecomputing device 10. In step 1, there is shown that at the end of achapter, a visual content 24 review is proposed and that in step 2, theuser 32 can rotate the portable computing device 10 to access the visualcontent 24 highlights. In step 3, the user 32 can touch a visual content24 to view and in step 4, it is possible for the user 32 to swipe tonavigate between visual contents 24. Furthermore, in step 5, the user 32can rotate the portable computing device 10 to return to the originaltext content 20.

According to an embodiment, when the user 32 first rotates the portablecomputing device 10, a first visual content 24 appears. After swiping tonavigate between visual contents 24, the user 32 may stop navigating ata different visual content 24. When the user 32 rotates the portablecomputing device again to show text content 20, the part of the textcontent 20 that is shown is the part that corresponds to the secondvisual content 24.

According to another embodiment and referring now to FIG. 9, there isshown a visual display 12 of the portable computing device 10. FIG. 9illustrates a visual content 24 accessed from the table of contents in adocument. In this embodiment, the existence of visual content 24 isindicated in the table of contents. Each visual content 24 has its ownvisual content indicator 22 (i.e., its visual bullet). In step 1, theuser 32 reviews the table of contents and in step 2, the user 32 canfinger touch a visual content indicator 22 (i.e., a dot or any othersuitable visual content indicator 22), to display the visual content 24.In step 3, a visual content 24 then slides down and in step 4, the user32 decides to rotate the portable computing device 10 to switch tolandscape mode 18 orientation. In step 5, the user 32 touches the textcontent 20 to get more details and in step 6, the user 32 rotates theportable computing device 10 to return to the table of contents.

According to another embodiment and referring now to FIGS. 10 and 11,there is shown a visual display 12 of the portable computing device 10.FIGS. 10 and 11 illustrate the visual display 12 of an eBook library.According to this embodiment, when an eBook with embedded visual contentindicators 22 and visual contents 24 has been bought, it is indicated inthe eBook library with a colored tab (i.e., an orange tab). FIG. 10illustrates the visual display 12 of an Apple iBook Library, and FIG. 11illustrates the visual display 12 of an Amazon Kindle Library.

According to another embodiment, the method for controlling the output14 presented on a visual display 12 of a portable computing device 10may be used for music needs, academic needs, news and other suitableneeds which would require such a method and portable computing device10.

According to another embodiment and referring now to FIG. 12, there isshown a visual display 12 of the portable computing device 10. FIG. 12illustrated academic eBooks. Indeed, the portable computing device 10 asdescribed above may be used for academic needs. There are a plurality ofbenefits to use the portable computing device 10 for academic uses. Itadds value to academic eBooks, it enhances the learning experience forstudents, it simplifies the teacher's preparation since editable visualcontent 24 and tools can be bought on-line, and the like. As shown inFIG. 12, in step 1, the user 32 (i.e., a teacher and/or students) canread the text content 20 and in step 2, the user 32 can review thevisual content 24. The user 32 (i.e., the teacher) can use similarvisual contents 24 during class. In step 3, the user 32 can use a slidedown panel comprising text contents 20 to access details in the textdata. This may enhance the learning experience.

According to another embodiment and referring now to FIG. 13, there isshown a visual display 12 of the portable computing device 10. FIG. 13shows that the computing portable device as described above may be anefficient method to study for an exam. In step 1, the user 32 (i.e., thestudent) can review the visual content 24 and in step 2, the user 32 canuse slide down text content 20 to access details in the text data. Instep 3, the user 32 (i.e., the student) can rotate the portablecomputing device 10 to return to the original text content 20.

According to another embodiment and referring now to FIG. 14, there isshown a visual display 12 of the portable computing device 10. FIG. 14illustrates the visual display 12 of a journal article on the portablecomputing device 10. In step 1, the user 32 reads a news article in theportrait mode 16 orientation. In step 2, the user 32 rotates theportable computing device 10 in the landscape mode 18 orientation tolook at the visual content 24 and in step 3, the user 32 swipes tonavigate between visual contents 24.

According to another embodiment and referring now to FIG. 15, there isshown a visual display 12 of the portable computing device 10. FIG. 15illustrates business and trade eBooks. Indeed, managers andprofessionals often read to enhance their general knowledge. Multiplestudies have shown that most of them are visual learners. All five wayspreviously described to make eReading a superior experience, in theprevious are applicable to business and trade eBooks. Accordingly, ifmanagers and/or professionals want to communicate or implement conceptsand practices from a book, they can buy an editable corporate version ofthe eBook with its visual content indicators 22.

According to another embodiment and referring now to FIG. 16, there isshown a visual display 12 of the portable computing device 10. FIG. 16illustrates that the method for controlling the output 14 presented on avisual display 12 of a portable computing device 10 is also useful fornovels. Indeed, authors may have visual content 24 in mind (i.e.,places, people, and the like) that they want the user 32 (i.e., thereader) to look at while reading the eBook. As shown, in step 1, theuser 32 (i.e., the reader) reads the novel in a portrait mode 16orientation and in step 2, the user rotates the portable computingdevice 10 in a landscape mode 18 orientation to view visual contents 24proposed by the author.

According to another embodiment and referring now to FIG. 17, there isshown a visual display 12 of the portable computing device 10. FIG. 17illustrates that the method for controlling the output 14 presented on avisual display 12 of a portable computing device 10 is also useful forweather forecasts. As shown, in step 1, the user 32 reads the weeklyforecast in the portrait mode 16 orientation and in step 2, the user 32rotates the portable computing device 10 in the landscape mode 18orientation to view the visual content 24 (i.e., the map).

According to another embodiment and referring now to FIG. 18, there isshown a visual display 12 of the portable computing device 10. FIG. 18illustrates that the method for controlling the output 14 presented on avisual display 12 of a portable computing device 10 is also useful forcook eBooks. As shown, in step 1, the user 32 reads the recipe in theportrait mode 16 orientation. In step 2, the user 32 decides to rotatethe portable computing device 10 in the landscape mode 18 orientation tolook at a video or decides to rotate the portable computing device 10 inthe landscape mode 18 orientation to look at a visual step of the recipeand in step 3, swipes to navigate between different cooking steps.

According to another embodiment and referring now to FIG. 19, there isshown a visual display 12 of the portable computing device 10. Whenvisual content indicators 22 are available on an eBook store forexample, it is indicated on the eBook itself. Also, the store may givean option to the user 32 to buy a standard eBook or an eBook availablewith the visual content indicators 22 and visual content 24. FIG. 19gives an example with the Apple iBook store. For example, an eBook withembedded visual contents 24 may cost twice as much as the regular priceof a standard eBook. It is also to be noted that visual contents 24 ineBooks are not editable. Also, visual indicators with visual contents 24cannot be bought alone, they have to be purchased with an eBook. Thus,FIG. 19 presents a first possible revenue model for such a portablecomputing device 10.

According to another embodiment and referring now to FIG. 20, there isshown a visual display 12 of the portable computing device 10. FIG. 20illustrated a second possible revenue model. eBooks with visual contentindicators 22 and visual content 24 may also be applicable for freeInternet content such as news, specialty or general content websites. Asshown, in step one, a user 32 reads a news article in the portrait mode16 orientation and in step 2, when the portable computing device 10 isrotated in the landscape mode 18 orientation to access the visualcontents 24, it triggers publicity or advertising. In step 3, after 5seconds, for example, the visual content 24 appears while a web bannerstays for an additional 25 seconds for example. In step 4, the webbanner disappears. In step 5, the user 32 rotates the portable computingdevice 10 in the portrait mode 16 orientation to return to text content20, etc. It is to be noted that in some cases, only one ad per articlecan appear, therefore, if a news article contains four visual contents24 (i.e., pictures, graphics, etc.), it would show a publicity only whenthe first visual content 24 appears.

According to another embodiment and referring now to FIG. 21, there isshown a visual display 12 of the portable computing device 10. FIG. 21illustrates a third possible revenue model, free content with membershipfee. Accordingly, a paying member of a website (i.e., a journal forexample) would not receive ads. As shown, in step 1, the user 32 reads anews article in the portrait mode 16 orientation. In step 2, the user 32rotates the portable computing device 10 in the landscape mode 18configuration to look at a visual content 24.

According to another embodiment and referring now to FIG. 22, there isshown a visual display 12 of the portable computing device 10. FIG. 22illustrates a fourth possible revenue model, free content with license.Accordingly, website owners may register their visual contents 24through a one-time fee, therefore, the user 32 will not receivepublicity. A license number may be issued for each visual content 24registered. As shown, in step 1, the user 32 reads a news article in theportrait mode 16 orientation and in step 2, the user 32 rotates theportable computing device 10 in the landscape mode 18 orientation, wherea license number appears.

According to another embodiment and referring now to FIG. 23, there isshown a visual display 12 of the portable computing device 10. FIG. 23illustrated that it is possible to rotate the portable computing device10 in both directions. It is possible to turn the portable computingdevice 10 in the clockwise direction to access the visual content 24 ofthe left side visual content indicator 22. It is also possible to turnthe portable computing device 10 in the counterclockwise direction toaccess the visual content 24 of the right side visual content indicator22.

According to another embodiment and referring now to FIG. 24, there isshown a visual display 12 of the portable computing device 10. FIG. 24shows that it is also possible to superimpose visual indicators. Asshown, in step 1, a user 32 reads and notice superimposed visual contentindicators 22. In step 2, the user 32 looks at the largest visualcontent indicator 22 (i.e., a blue bar for example) and in step 3, theuser 32 swipes to access the second (i.e., the smallest) visual contentindicator 22 (i.e., the blue bar). Alternatively, in step 2, the user 32may touch a targeted visual content indicator 22 (i.e., a targeted leftblue bar) to display the associated visual content 24 and in step 3, theassociated visual content 24 appears.

According to another embodiment and referring now to FIG. 25, there isshown a visual display 12 of the portable computing device 10. FIG. 25shows that it is possible to have visual content 24 adapted to textcontent 20 with the use of geolocalisation. As shown, in step 1, whenusing geolocalisation on a portable computing device 10, the visualcontent 24 in a portrait mode 16 orientation guides the user 32. In step2, when the user 32 sees the same external visual as the visual content24 (i.e., a building for example), he rotates the portable computingdevice 10 to access text content 20 in the portrait mode 16 orientation,or trigger an audio or video.

According to another embodiment and referring now to FIG. 26, there isshown a visual display 12 of the portable computing device 10. FIG. 26illustrates that it is further possible to perform on-line shopping. Asshown, a visual content indicator 22 (i.e., the blue line) may indicate,in the landscape mode 18 orientation, that there exists text content 20associated with the visual content 24. In step 1, the user 32 (i.e., theeShopper) looks at a visual content 24 and in step 2, the user 32 swipesto navigate between visual contents 24. In step 3, the user 32 rotatesthe portable computing device 10 in the landscape mode 18 orientation toaccess text content 20.

According to another embodiment and referring now to FIG. 27, there isshown a visual display 12 of the portable computing device 10. FIG. 27illustrates that a multiple-color coded visual content indicator 22 mayappear. Visual content indicators 22 can be color coded or use textureto indicate different kind of visual content 24. As shown, a firstvisual content indicator 22 (i.e., the upper blue indicator) may allowthe user 32 to see a book exhibit, while a second visual contentindicator 22 (i.e., the lower red indicator) may allow the user 32 tosee a text summary.

According to another embodiment and referring now to FIG. 28, there isshown a visual display 12 of the portable computing device 10. FIG. 28illustrates that multiple visual indicators may be located in the samepage. As shown, in step 1, the user 32 reads and notices superimposedvisual content indicators 22 (i.e., superimposed blue bars). In step 2,the user 32 looks at the visual content 24 of the first visual contentindicator 22 and in step 3, swipes to access the visual content 24 ofthe second visual content indicator 22. Alternatively, in step 2, theuser 32 may touch a targeted visual content indicator 22 (i.e., atargeted left blue bar) to display the corresponding visual content 24and in step 3, the corresponding visual content 24 appears.

According to another embodiment and referring now to FIG. 29, there isshown a visual display 12 of the portable computing device 10. FIG. 29illustrates that the portable computing device 10 also allows for ahorizontal text format or a landscape mode 18 orientation only. Asshown, in step 1, the user 32 reads the text content 20 in the landscapemode 18 orientation. In step 2, the user 32 touches the visual contentindicator 22 to access visual content 24. In step 3, the user 32 looksat the visual content 24 and in step 4, the user 32 clicks on a “X”symbol, or on any suitable icon, or swipes toward left side. In step 5,the user 32 has returned to the original text content 20.

According to another embodiment and referring now to FIG. 30, there isshown a visual display 12 of the portable computing device 10. FIG. 30illustrates that a finger swipe to a next page could trigger a visualcontent 24, especially to surprise the reader (i.e., the user 32) of theportable computing device 10. As shown, in step 1, the user 32 reads inthe portrait mode 16 orientation. In step 2, the user 32 swipes to getto the following page and in step 3, the change of page automaticallytriggers the visual content 24 or a video, a sound and the like. In step4, the user 32 presses anywhere in the text content 20 and in step 5,the user 32 is back to the text content 20.

According to another embodiment and referring now to FIG. 31, there isshown a visual display 12 of the portable computing device 10. FIG. 31illustrates that it is possible to zoom in and out the visual content24. As shown, in step 1, the user 32 looks at the visual content 24 onthe landscape mode 18 orientation. In step 2, the user 32 uses hisfingers to zoom in or zoom out the visual content 24.

According to another embodiment and referring now to FIG. 32, there isshown a visual display 12 of the portable computing device 10. FIG. 32shows that pertinent visual contents 24 can be tagged and reviewed in asummary. Steps 1 to 3 illustrate the tagging process. In step 1, theuser 32 looks at the visual content 24 and in step 2, the user 32 tagspertinent visual content 24 by double clicking on the visual content 24.In step 3, a tag (i.e., a colored tag for example) will appear.

According to another embodiment and referring now to FIG. 33, there isshown a visual display 12 of the portable computing device 10. Steps 1to 2 of FIG. 33 illustrate the reviewing process following the taggingprocess of FIG. 32. In step 1, in the table of contents, the taggedvisual contents 24 will appear (i.e., in color boxes for example). Instep 2, the user 32 finger touches the tagged visual contents 24 toreview tagged visual contents 24. Alternatively, in step 2, the user 32touches on the box (i.e., the bottom box) with the finger to review onlytagged contents.

According to another embodiment and referring now to FIG. 34, there isshown a visual display 12 of the portable computing device 10. FIG. 34illustrates that the table of content can be looked in visual content 24using the landscape mode 18 orientation. As shown, in step 1, the user32 looks at a standard table of contents in the portrait mode 16orientation. In step 2, the user 32 rotates the portable computingdevice 10 to view the table of contents as a visual content 24. In step3, the user 32 touches on a chapter title or number to access itssummary as a visual content 24 and in step 4, the user 32 touches aspecific visual content 24. In step 5, the user 32 looks at the visualcontent 24 in a full size view.

According to another embodiment and referring now to FIG. 35, there isshown a visual display 12 of the portable computing device 10. FIG. 35illustrates that it is possible, when multiple visual contents 24 arepresented, to display a slide show. As shown, in step 1, the user 32looks at multiple visual contents 24. In step 2, the user 32 touches thescreen of his portable computing device 10 and draws a circle toactivate the slide show. In step 3, the user 32 looks at the visualcontent 24 in a full size view. In step 4, the user 32 looks at thesecond visual content 24 which will appear on the screen after a certainperiod of time (i.e., 5 seconds for example), and so on.

According to another embodiment and referring now to FIG. 36, there isshown a visual display 12 of the portable computing device 10. FIG. 36shows that the user 32 can pick favorite visual contents 24 from variousbooks which are kept in a consolidated bucket. As shown, in step 1, theuser 32 tags a visual content 24 by double touching on the visualcontent 24. In step 2, the user 32 touches the tag (i.e., a color tag)and selects “add to favorite” in the menu bar.

According to another embodiment and referring now to FIG. 37, there isshown a visual display 12 of the portable computing device 10. FIG. 37shows that it is possible, when there is a visual content indicator 22in the text content 20, to display the visual content 24 in the portraitmode 16 orientation by swiping finger toward the right side of thescreen of the portable computing device 10. As shown, in FIG. 1, theuser 32 looks at the text in the portrait mode 16 orientation and instep 2, the user 32 swipes toward the right side to pull the visualcontent 24. In step 3, the user 32 looks at the visual content 24 in theportrait mode 16 orientation. In step 4, if necessary, the user 32rotates the portable computing device 10 to look at the visual content24 in a full size view. The right direction in this embodiment could bereplaced by another direction such as left, up, down or diagonals, forexample.

According to another embodiment, each time a rotation of the portablecomputing device 10 occurs, a count of rotations is incremented. Thiscount of each time a visual content is displayed can be stored on thememory 30. If there is a connection to a communication network, thecount can be sent to an external memory, such as on a remote server orcomputer. Storing the count can be temporary or permanent. The storingcan be useful for the implementation of a payment based on the number ofrotations/on the number of counts.

It should also be considered that for many features described herein andtheir accompanying figures, the portrait and landscape modes (16, 18)are interchangeable. Therefore, the terms “portrait” and “landscape”modes are used to reflect that in most applications found on portablecomputing devices 10, text is displayed in a portrait mode 16 andpictures are presented in a landscape mode 18. Nonetheless,interchanging both modes or using modes that would be off the verticaland horizontal axes are considered as possible variants comprised in thescope of the disclosure.

While preferred embodiments have been described above and illustrated inthe accompanying drawings, it will be evident to those skilled in theart that modifications may be made without departing from thisdisclosure. Such modifications are considered as possible variantscomprised in the scope of the disclosure.

1. A method for controlling an output presented on a visual display of aportable computing device having an orientation, the portable computingdevice comprising a memory on which is stored visual content comprisingat least one of graphics data, photo data and video data, and textcontent substantially comprising text data, the text content furthercomprising a visual content indicator indicative of the existence of thevisual content which is different from the visual content indicator, themethod comprising: detecting the orientation of the portable computingdevice as corresponding to one of a first display mode and a seconddisplay mode; in the orientation corresponding to the first displaymode, presenting the text content on the visual display in the firstdisplay mode; in the presence of the visual content indicator, detectinga change of the orientation corresponding to the first display mode tothe orientation corresponding to the second display mode; and in theorientation corresponding to the second display mode, presenting thevisual content in the second display mode on the visual display whereinthe change of the orientation from the first display mode to the seconddisplay mode triggers the presenting of the visual content correspondingto the visual content indicator.
 2. The method of claim 1, wherein thedetecting the orientation as corresponding to one of a first displaymode and a second display mode comprises detecting the orientation ascorresponding to one of a portrait mode and a landscape mode,respectively.
 3. The method of claim 1, further comprising, in theorientation corresponding to the second display mode, detecting thechange of the orientation corresponding to the first display mode to theorientation corresponding to the second display mode, for presenting thetext content on the visual display in the first display mode.
 4. Themethod of claim 1, further comprising, in the orientation correspondingto the first display mode, selecting the visual content indicator fortriggering a display of the visual content on the visual display, theselecting comprising at least one of clicking and tapping on the visualcontent indicator presented on the visual display.
 5. The method ofclaim 1, wherein the presenting a text content comprising a visualcontent indicator comprises presenting a text content comprising aplurality of visual content indicators indicative of the existence of acorresponding plurality of visual contents, and wherein detecting thechange of the orientation in the presence of a visual indicatorcomprises detecting the change of the orientation in the presence of theplurality of visual content indicators, and wherein presenting thevisual content in the second display mode comprises presenting one ofthe plurality of the visual contents.
 6. The method of claim 1, furthercomprising, in the orientation corresponding to the second display mode,swiping the visual display for introducing a panel comprising the textcontent for displaying both the text content and the visual content onthe visual display.
 7. The method of claim 1, wherein the presenting atext content on the visual display comprises presenting a text contentcomprising a table of contents on the visual display, the table ofcontents comprising a visual indicator indicative of the existence ofvisual content.
 8. The method of claim 1, further comprising, afterpresenting the visual content, detecting a swipe on the visual displayfor navigating between a plurality of visual contents.
 9. The method ofclaim 8, further comprising, in the orientation corresponding to thesecond display mode in which a given visual content is displayed,detecting the change of the orientation corresponding to the firstdisplay mode to the orientation corresponding to the second displaymode, for presenting on the visual display, in the first display mode,the text content which corresponds to the given visual content.
 10. Themethod of claim 1, further comprising generating a count of each changeof the orientation corresponding to the first display mode to theorientation corresponding to the second display mode, and at least oneof: storing the count on the memory and sending the count to a remoteserver via a communication network.
 11. The method of claim 10, furthercomprising determining a payment based on the count.
 12. A portablecomputing device for controlling an output presented on a visualdisplay, the portable computing device comprising: a visual displaypresenting an output; a detector for detecting an orientation of theportable computing device, the orientation corresponding to one of afirst display mode and a second display mode; a processing device incommunication with the visual display and the detector; a memory forstoring: visual content comprising at least one of graphics data, photodata and video data, and text content substantially comprising textdata, the text content further comprising a visual content indicatorindicative of the existence of the visual content which is differentfrom the visual content indicator; and instructions which cause theprocessing device: to detect the orientation of the portable computingdevice as corresponding to one of the first display mode and the seconddisplay mode; in the orientation corresponding to the first displaymode, to present the text content on the visual display in the firstdisplay mode; in the presence of the visual content indicator, to detecta change of the orientation corresponding to the first display mode tothe orientation corresponding to the second display mode; and in theorientation corresponding to the second display mode, to present thevisual content in the first display mode on the visual display whereinthe change of the orientation from the first display mode to the seconddisplay mode triggers the presenting of the visual content correspondingto the visual content indicator.
 13. The portable computing device ofclaim 12, wherein the detector for detecting an orientationcorresponding to one of a first display mode and a second display modecomprises a detector for detecting an orientation corresponding to oneof a portrait mode and a landscape mode.
 14. The portable computingdevice of claim 12, wherein the memory is further for storinginstructions which cause the processing device to, in the orientationcorresponding to the first display mode and upon a swipe on the visualdisplay, display a panel comprising the text content for displaying boththe text content and the visual content on the visual display.
 15. Aninteractive application for controlling an output presented on a visualdisplay of a portable computing device comprising a memory, theinteractive application comprising: a detection module for detecting anorientation of the portable computing device, the orientationcorresponding to one of a first display mode and a second display mode;a text content substantially comprising text data for display when theorientation corresponds to the first display mode; a visual contentindicator presented within the text content, the visual contentindicator being indicative of the existence of visual content comprisingat least one of graphics data, photo data and video data, the visualcontent being different from the visual content indicator; and thevisual content presented when the detection module detects that theorientation corresponding to the first display mode changes to theorientation corresponding to the second display mode in presence of thevisual content indicator, wherein the text content, the visual contentindicator and the visual content are stored on the memory and the changeof the orientation from the first display mode to the second displaymode triggers the presenting of the visual content corresponding to thevisual content indicator.
 16. The interactive application of claim 15,wherein the detection module for detecting an orientation correspondingto one of a first display mode and a second display mode comprises adetection module for detecting an orientation being one of a portraitmode and a landscape mode, respectively.
 17. The interactive applicationof claim 15, wherein the text content is an electronic book.
 18. Theinteractive application of claim 15, wherein the text content furthercomprises a table of contents, the table of contents comprising thevisual indicator indicative of the existence of the visual content. 19.The interactive application of claim 15, further comprising, when theorientation is detected to correspond to the first display mode, a panelcomprising the text content for displaying both the text content and thevisual content on the visual display.
 20. The interactive application ofclaim 15, wherein the visual indicator comprises a plurality of visualindicators indicative of the existence of a corresponding plurality ofvisual contents, and wherein the detection module for displaying thevisual content comprises a detection module for displaying one of thevisual contents which corresponds to one of the plurality of visualindicators.